Python Job: AWS Data Engineer

Job Type

Category

Location

Job Details

Role: AWS Data Engineer
Job Type: Permanent
Location: Letterkenny (Hybrid – onsite 2 days per month as per business needs)

Ready to utilise your experience/skills in the latest Cloud Data Solutions?
Are you passionate about helping customers modernise and execute on their data strategies?

Join us an AWS Data Engineer and be part of a collaborative AWS Data Engineering team to develop end-to-end AWS solutions as well as take on a fantastic career growth opportunity!

Careers at TCS: It means more.
TCS is a purpose-led transformation company, built on belief. We do not just help businesses to transform through technology. We support them in making a meaningful difference to the people and communities they serve - our clients include some of the biggest brands in the UK and worldwide. For you, it means more to make an impact that matters, through challenging projects which demand ambitious innovation and thought leadership.

• Be part of an exciting team where you will be challenged every day.
• Work closely with the range of teams within the business to bring products to life.
• Work with customers and identify opportunities to support their strategy and improve their processes across functions.

The Role
This role involves working with High Performing Agile teams in enabling a large financial Institution to execute on their Cloud\Data journey, reinventing core functionality on Legacy infrastructure and building a best-in-class solution on the Cloud.

Key responsibilities:

• Develop data pipeline using SQL, Python, Spark.
• Utilise RDBMS knowledge to migrate data to AWS cloud.
• Work with Spark Dataframes and Spark SQL for ETL and data analytics.
• Collaborate to support Data security.
• Use CloudWatch and Splunk for monitoring and logging.
• Use AWS Step Functions & Eventbridge for orchestration of data pipelines.
• Develop data visualisation and BI reports using PowerBI/Tableau.
• Conduct data validation and data scrubbing.
• Conduct version control and code deployment using Bitbucket and Jenkins.
• Assemble large, complex data sets that meet functional / non-functional business requirements.
• Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery and data validation, re-designing infrastructure for greater scalability, etc.
• Build the framework required for optimal extraction, transformation, and loading of data from a wide variety of data sources using SQL and AWS ‘big data’ technologies.
• Build tools that utilize the data pipeline to provide actionable insights into customer acquisition, operational efficiency and other key business performance metrics.
• Work with stakeholders including the Product, Data and Design teams to assist with data-related technical issues and support their data needs.

Your Profile
Key skills/experience:

• Experience developing and deploying application code using SQL, Python, spark.
• Proven expertise in developing and deploying data pipeline in cloud.
• Solid experience in AWS using glue, athena, lambda, secrets manager, redshift, redshift spectrum, postgreSQL, cloudformaton, step functions, s3, ec2, boto3.
• Understanding of securing data using IAM and Active Directory
• Exposure to developing Linux, UNIX shell scripts
• Experience with monitoring and logging techniques to be used in conjunction with Cloudwatch and Splunk.
• Working knowledge of version control tools and branching techniques using Artifactory, Jenkins, and Bitbucket.
• Understanding of Agile methodologies and practices.

Good to have:

• Financial services tech experience.
• Developer experience in big data or warehouse (Hadoop, DB2 LUW) environment may be beneficial.
• AWS Cloud Practitioner certification, or other AWS certification.

Rewards & Benefits
TCS is consistently voted a Top Employer in the UK&I and globally. Our competitive salary packages feature generous bonus, pension, health care and life assurance with access to extensive training resources and discounts within the larger Tata network.

Diversity, Inclusion & Wellbeing

At TCS, we believe in building and sustaining a culture of equity and belonging where everyone can thrive. Our diversity motto is ‘Inclusion without Exception’.
We encourage applications from all sections of society. As an equal opportunity employer, we do not discriminate on grounds of race, religion or belief, ethnic or national origin, disability, age, sex, pregnancy and maternity, citizenship, marital, domestic or civil partnership status, sexual orientation, gender reassignment, gender identity, or any other basis as protected by applicable law.
TCS is committed to working with and providing reasonable accommodations to its employees and applicants for employment to ensure that individuals with disabilities enjoy equal access to all employment opportunities. If you are an applicant who needs an accommodation due to a disability to complete an employment application or during any phase of the hiring process, please contact us at with the subject line: "Disability Accommodation Request".

Due to a high volume of applications, we will be unable to contact each applicant individually regarding the status of their application. If you have not received a direct response within 30 days, then the application should be deemed unsuccessful.


Join us and do more of what matters. Apply online now.